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(54) Subtitle colorwiping and positioning 



(57) Dynamic positioning of subtitles for a video im- 
age is achieved by encoding and decoding the subtitles 
separately from the video image. At the encoder (Fig. 
7), subtitles are generated (55) for each respective vid- 
eo image. At the decoder (Fig. 2), a buffer (22) stores 
the subtitles along with subtitle decoding information. A 



controller (35) precisely times a reading operation of the 
buffer to read out the subtitles during a real time display 
of the respective video image. Dynamic positioning of 
the subtitles is achieved by delaying the time the con- 
troller executes the read operation. When the decoding 
technique is repeated for a number of frames, the viewer 
senses motion as the positioning gradually changes. 
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Description 

[0001] The present invention relates to subtitles and, 
more particularly, to colorwiping and positioning subti- 
tles. 

[0002] Subtitles are superimposed on a video image 
to convey information to a viewer which supplements 
the video image. In Karaoke, for example, lyrics of songs 
are displayed on the video image as subtitles while a 
viewer sings along to an audio track of an accompanying 
video image. The subtitles also convey information to 
the viewer in the manner in which they are displayed. 
Highlighting the lyrics of songs in Karaoke, for example, 
cues the singer to sing, while moving the lyrics off the 
video screen indicates to the viewer to stop singing. 
[0003] Television broadcasting or video reproduction 
(such as from a video disk) provides subtitles for display 
with the video image. However, the subtitles are perma- 
nently combined with the underlying video image and 
can be manipulated only at the transmitting (or record- 
ing) end and not at the receiving (or reproducing) end. 
That is, subtitles displayed in television broadcasting or 
video reproduction are "fixed" and cannot be highlighted 
or moved at the receiving (or reproduction) end. The 
subtitles also cannot be turned off, which is particularly 
important in Karaoke where a singer wants to test his/ 
her singing abilities or enjoy the music video without the 
interruption of the subtitles. 

[0004] The television broadcasting and reproduction 
systems cannot adequately manipulate the subtitles at 
the transmitting (or recording) end. The television 
broadcasting and reproduction systems require pains- 
taking trial and error creation and manipulation of sub- 
titles. In Karaoke, for example, where sing-along music 
videos are mass produced, it is desirable that each mu- 
sic video be produced quickly and efficiently. This is not 
possible with the television broadcasting and reproduc- 
tion systems which require slow and tedious work to 
custom tailor each music video. Notably, dynamic posi- 
tioning in a fixed-type television broadcast or recording 
is not possible because the subtitles are an integral part 
of video picture. Moving the subtitles, therefore, would 
leave a blank space where the subtitles were once su- 
perimposed. 

[0005] Compact Disc Graphics (CD-G) provide more 
flexibility in displaying subtitles because this technique 
records graphics on a compact disc (CD) in the form of 
subcodes. However, CD-G has a serious disadvantage 
because this technique is limited to CD applications, 
which are slow by television standards. That is, the 
CD-G technique does not lend itself to creation and ma- 
nipulation of subtitles in real-time television broadcasts 
or video reproductions. 

[0006] CD-G is successful for computer applications 
because the graphics are programmed in advance and 
the large processing time required to create the graphics 
is largely unseen by the end user. As will be shown with 
reference to Figs. 16a-16c and 17, however, the lead 



time required to generate a full CD-G screen is 10.24 
seconds, which is grossly inadequate for normal televi- 
sion or video broadcasts. 

[0007] Fig. 1 6a depicts the CD-G data format in which 
one frame includes 1 byte of a subcode and 32 bytes of 
audio channel data. Of the 32 bytes, 24 bytes are allo- 
cated for L and R audio channel data (each channel hav- 
ing 6 samples with 2 bytes per sample) and 8 bytes are 
allocated to an error correction code. The frames are 
grouped as a block of 98 frames (Frame 0, Frame 1 , 
Frame 96 and Frame 97) as shown in Fig. 16b. Eight 
blocks P.C^R.S.T.U.V and W are transmitted as shown 
in Fig. 16c. The subcodes for Frames 0 and 1 in each 
block are defined as sync patterns SO, S1 , whereas the 
remaining 96 frames store various subcode data. 
Among a group of 8 blocks, the first 2 blocks P, Q are 
allocated to search data employed for searching 
through record tracks; and graphic data can be allocated 
to the subcodes in the remaining 6 blocks R,S,T,U,V and 
W. 

[0008] Since each block of 98 frames is transmitted 
at a repeating frequency of 75 Hz, the data transmission 
rate for 1 block is (75 x 98 bytes) 7.35 kHz, resulting in 
a subcode bit rate of 7.35 K bytes/s. The transmission 
format for transmitting the information present in blocks 
R,S,T,U,V and W is shown in Fig. 17. Each of the 96 
frames (2,3,... 97) of the 6 blocks (R.S.T.U.V and W) is 
arranged as a packet including 6 channels (R to W) of 
96 symbols per channel. The packet is further subdivid- 
ed into 4 packs of 24 symbols each (symbol 0 to symbol 
23), with each symbol representing a frame. 
[0009] A CD-G character is made up of 6 x 12 pixels. 
Since each pack is 6 x 24, a 6 x 12 character is easily 
accommodated in each pack. The CD-G format allo- 
cates the six channels of (R,S,T,U,V and W) and the 1 2 
symbols 8 to 19 to a character. The remainder of the 
symbols in each of the packs store information about 
the character. 

[0010] Mode information is stored in the first 3 chan- 
nels (R, S, T) of symbol 0 in each pack, and item infor- 
mation is stored in the last 3 channels (U, V, W) of sym- 
bol 0. A combination of the mode information and the 
item information defines the mode for the characters 
stored in the corresponding pack as follows: 



Table 1 


Mode 


Item 


000 


000 mode 


001 


000 graphics mode 


001 


001 TV-graphics mode 


111 


000 user's mode 



[0011] An instruction is stored in all of the channels 
off symbol 1 . Corresponding mode, item, parity or addi- 
tional information for the instruction is stored in ail of the 
channels of symbols 2 to 7. Parity for all of the data in 
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the channels of symbols 0 to 19 is stored in all of the 
channels of the last 4 symbols (symbols 20 to 23) of 
each pack. 

[0012] As discussed, the data is transmitted at a re- 
peating frequency of 75 Hz. Therefore, a packet which 
contains 4 packs is transmitted at a rate of 300 packs 
per second (75 Hz x 4 packs). That is, with 1 character 
allocated to the range of 6 x 12 pixels, 300 characters 
can be transmitted in 1 second. 

[0013] However, a CD-G screen requires more than 
300 characters. A CD-G screen is defined as 288 hori- 
zontal picture elements x 192 vertical picture elements 
and requires more than twice the 300 characters trans- 
mitted in 1 second. The total transmission time for a 288 
x 192 screen is, therefore, 2.56 seconds as shown by 
the following equation: 

(288/6) x (192/12) 300 = 2.56 seconds 

[0014] This is extremely long to regenerate each 
screen when it is considered that screens are usually 
refreshed every 0.6 seconds. This problem is com- 
pounded when hexadecimal codes are used for the 
characters because each hexadecimal expression re- 
quires 4 bits to represent 1 pixel. As a result, 4 times the 
data described above is transmitted increasing the 
transmission rate to 10.24 seconds (4 x 2.56 seconds). 
Since each screen requires a sluggish 10.24 seconds 
for transmission, a continual transmission of screens 
means that a lag time of 10.24 seconds is experienced 
when transmitting screens using the CD-G technique. 
[0015] Thus, the CD-G technique is not performed in 
real time and is unacceptably slow for use in a real time 
broadcast. In generating Karaoke music videos, for ex- 
ample, it would be nearly impossible to synchronize the 
subtitles with the precise moment the lyrics are to be 
sung because the subtitles would have to be generated 
1 0.24 seconds in advance of the music video. 
[0016] The CD-G system also suffers from defects in 
reproducing the subtitles. The CD-G system displays 
subtitles only upon normal reproduction and not during 
special reproduction such as a fast forward or fast re- 
verse reproduction. CD-G pictures are also subject to 
sing phenomena (in which oblique portions of a charac- 
ter are ragged) or flickering because this system allo- 
cates only one bit of data for each picture element. The 
lag time of the CD-G picture also prevents switching the 
subtitle display on or off at a high speed. 
[001 7] In one type of system (known as the CAPTAIN 
system), dot patterns, as well as character codes, rep- 
resent the subtitles. This system, however, does not ap- 
pear to be any better than the CD-G system and suffers 
from some of the same disadvantages. In both systems, 
for example, the subtitles lack refinement because 
these systems do not provide sufficient resolution power 
in displaying the subtitles. 

The CAPTAIN system, for example, is developed for a 



248 (horizontal picture elements) by 1 92 (vertical picture 
elements) display and not for high resolution video pic- 
tures of 720 x 480. 

[0018] Respective aspects of the invention are set out 
5 in the respective independent claims hereof. 

[0019] A position decoding method and apparatus ac- 
cording to another aspect of the invention dynamically 
positions the subtitles in any region of the video image. 
A video decoder decodes video data of a video image 
to to be displayed. A buffer stores the subtitles forthe video 
image including decoding information. Acontrollertimes 
the precise moment when the subtitles are to be read 
out from the buffer during a real time display of said vid- 
eo image and a positioning unit dynamically changes 
15 the position where the subtitles are superimposed on 
the video image. 

[0020] A preferred form of implementation of the in- 
vention described hereinbelow with reference to the ac- 
companying drawings provides colorwiping and dynam- 
ic ic positioning of subtitles. Since the subtitles are encod- 
ed and decoded separately from the video image, the 
subtitles may be manipulated with great control and in 
real time. 

Colorwiping is achieved quickly and efficiently, allowing 
25 an operator to mass produce subtitled video pictures 
custom tailored to satisfaction. Dynamic positioning of 
the subtitles is equally as quick and efficient. 
Applying the colorwiping and positioning over a period 
of frames, the end viewer is provided with the sensation 
30 of motion as the subtitles are gradually colorwiped or 
repositioned over a period of time. These and other ad- 
vantages will be noted upon a review of the description 
of the preferred form of implementation given below with 
reference to the drawings. 
35 [0021] The preferred form of implementation of the in- 
vention provides: 

a subtitle method and apparatus for colorwiping 
subtitles; 

40 a subtitle method and apparatus which colorwipes 
subtitles at the command of an operator and in real 
time; 

a subtitle method and apparatus for dynamically po- 
sitioning subtitles; and 
45 a subtitle method and apparatus which dynamically 
positions subtitles at the command of an operator 
and in real time. 

[0022] The invention will now be further described, by 
50 way of illustrative and non-limiting example, with refer- 
ence to the accompanying drawings, in which: 

Fig. 1 is a block diagram of a data decoding appa- 
ratus embodying the invention; 
55 Fig. 2 is a block diagram of a subtitle decoder de- 
picted in Fig. 1 ; 

Fig. 3 is a table of communications between a sys- 
tem controller of Fig. 1 and a controller of Fig. 2; 



40 



45 



55 



J 



5 



EP 1 326 451 A1 



6 



Fig. 4 is a table of parameters for communications 
between components of Fig. 1 and Fig. 2; 
Figs. 5a to 5c are signal diagrams demonstrating 
data encoding in accordance with an embodiment 
of the invention; 

Fig. 6 is a color look up table referred to when en- 
coding subtitle data; 

Figs. 7a and 7b constitute a block diagram of en- 
coding apparatus embodying the invention; 
Figs. 8a and 8b depict a block diagram for a wipe 
data sampler of Fig. 7a; 

Fig. 9 is a color look up table referred to when con- 
ducting a color wipe operation; 
Fig. 1 0 is a graph forthe explanation of a code buffer 
operation; 

Fig. 11 is a block diagram describing the internal 

operation of a code buffer in Fig. 2; 

Figs. 1 2a to 12c depict a scheme forthe colorwiping 

operation; 

Fig. 1 3 is a block diagram depicting the colorwiping 
operation according to Figs 12a to 12c; 
Figs. 1 4a to 1 4c depict a scheme for a dynamic po- 
sitioning operation; 

Fig. 1 5 is a block diagram depicting the dynamic po- 
sitioning operation according to Figs. 14a to 14c; 
Figs. 1 6a to 1 6c depict the arrangement of data ac- 
cording to a CD-G format; and 
Fig. 1 7 depicts a transmission format of the data in 
the CD-G format. 

[0023] Referring now to the drawings, wherein like ref- 
erence numerals designate identical or corresponding 
parts throughout, a preferred form of implementation of 
the invention will be described. 

Decoding Apparatus 

[0024] The data decoding apparatus shown in Fig. 1 
which incorporates the present invention decodes a re- 
production signal. The system controller 14 of the data 
decoding apparatus causes the reproduction signal to 
be processed and sent to a subtitle decoder 7. The sys- 
tem controller communicates with the controller 35 (Fig. 
2) of the subtitle decoder to decode the subtitles and 
superimpose them onto a decoded video image for dis- 
play on a television screen. 

[0025] A data decoder and demultiplexer 1 receives 
a digital reproduction signal from, for example, a VCR. 
The data decoder and demultiplexer 1 error decodes the 
reproduction signal preferably employing an Error Cor- 
recting Code (ECC) technique and demultiplexes the er- 
ror decoded reproduction signal into video, subtitle and 
audio data. A memory 2 may be used, for example, as 
a buffer memory and a work area for the purpose of error 
decoding and demultiplexing the reproduction signal. 
[0026] A video decoder 3 decodes the demultiplexed 
video data from a video data stream. A memory 4 may 
be employed for the operation of decoding the video da- 



ta similar to the operation of the memory 2 employed 
with data decoder and demultiplexer 1 . 
[0027] A letter box circuit 5 converts a video picture 
with a 4:3 aspect ratio (a squeeze mode) to a 1 6:9 letter 
5 box ratio. 

The conversion is performed using a 4 to 3 decimation 
process, whereby every four horizontal lines are deci- 
mated to three horizontal lines, thus squeezing the video 
picture into a % picture. According to the letter box for- 

10 mat, a vertical resolution component is derived from the 
remaining % of the video picture which is employed to 
enhance the vertical resolution of the decimated video 
picture. A timing control memory 6 ensures that the Va of 
the letter box picture is not transmitted. When the de- 

15 coded video data generated by the video decoder 3 is 
already in a 16:9 letter box format, the letter box circuit 
bypasses the decimation operation and sends the de- 
coded video data directly to the subtitle decoder 7. 
[0028] Meanwhile, the decoded subtitle data demulti- 

20 plexed by the data decoder and demultiplexer 1 is di- 
rectly sent to the subtitle decoder 7. The subtitle decoder 
7 decodes the subtitle data according to instructions 
from the system controller 14 and mixes the decoded 
subtitle data with the decoded video data. 

25 [0029] A composite encoder 8 encodes the mixed 
subtitle data and video data into a suitable video picture 
format, such as NTSC/PAL. A mode display 9 interfaces 
with a user and indicates, for example, the mode of tel- 
evision monitor connected thereto. A D/A converter 10 

30 converts the encoded signal received from the compos- 
ite encoder 8 into an analog signal suitable for display 
in the indicated mode, such as NTSC or PAL. 
[0030] The audio portion of the audio/video signal de- 
coded by the data decoder and demultiplexer 1 is de- 

35 coded by an audio decoder 11 which decodes the de- 
multiplexed audio data using a memory 1 2, for example. 
The decoded audio data output from the audio decoder 
is converted into an analog audio signal appropriate for 
broadcast through a television monitor by a D/A convert- 

40 er13. 

Subtitle Decoder 

[0031] The subtitle decoder 7, as will be discussed 
45 with reference to Fig. 2, decodes the encoded subtitle 
data and mixes the decoded subtitle data with the ap- 
propriate video data. A controller 35 controls the oper- 
ations of the subtitle decoder and communicates with 
the system controller 14 of the decoder (Fig. 1) using 
50 the command signals shown in Fig. 2 (as listed in Fig. 
3.) Together, the controller and system controller time 
the decoding of the subtitle data so that the subtitle data 
is mixed with video image data at the precise position 
the subtitles are to appear on the video image. 
55 [0032] The word detector 20 of the subtitle decoder 7 
receives the subtitle data in groups of bit streams. Each 
group of bit streams makes up one frame (or page) of 
subtitles to be superimposed on a video image. Different 
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groups of streams may represent subtitles displayed in 
different playback modes, such as normal playback, 
fast-reverse or fast -forward. The system controller indi- 
cates to the word detector using a stream_select signal 
which playback mode to display and the word detector 
selects the appropriate stream of signals for the indicat- 
ed playback mode. In the case where different video im- 
ages are displayed on different channels, the system 
controller indicates the appropriate channel to the word 
detector correspondingly in a ch_select signal and the 
word detector changes channels to receive only those 
streams on the selected channel. 
[0033] A group of bit streams making up one frame 
and received by the word detector include header infor- 
mation (s. header) which describes the format of the 
group of bit streams. The header information is accom- 
panied with header error information (header error) and 
data error information (data error). The system control- 
ler uses the header io determine how to parse the group 
of bit streams and extract the relevant subtitle data. The 
system controller uses the header error information to 
correct anomalies in the header information and uses 
the data error information to correct anomalies in the 
subtitle data. 

[0034] The word detector forwards the subtitle data 
(Bitmap) along with other decoding information (includ- 
ing a presentation time stamp PTS, position data 
position_data and color look up table data 
CLUT_data) to the code detector 22. The PTS is a sig- 
nal that indicates the length of time the subtitles are to 
be displayed. The position data indicates the horizontal 
and vertical position where the subtitles are to be super- 
imposed on the video image. The GLUT_data indicates 
which colors are to be used for the pixels making up the 
subtitles. For example, the system controller determines 
that a video image is being displayed and causes the 
code buffer to output the corresponding subtitle data 
(Bitmap) at a position in the video image represented 
by the horizontal and vertical position indicated by the 
position_data, in the color indicated by the CLUT_data 
and for a period of time indicated by the PTS. 
[0035] A scheduler 21 is provided to ensure that the 
data received from the demultiplexer 1 (Fig. 1) does not 
overflow the code buffer 22. The scheduler controls 
read/write access to the code buffer by determining a 
bandwidth for an I/O port (not shown) which receives 
the bit streams selected by the word detector. The band- 
width refers to the number of parallel bits supplied to the 
I/O port at one time and is calculated by dividing the rate 
at which the demultiplexer demultiplexes data by the 
rate at which data is read from the code buffer. For ex- 
ample, a data rate from the demultiplexer of 20 Mbps 
divided by a 2.5 Mbps rate of data read from the code 
buffer is equal to 8 bits. Therefore, the scheduler will set 
the I/O port to receive 8 bits in parallel in order to main- 
tain a consistent flow rate of data into and out of the 
code buffer. The code buffer, thus, receives the subtitle 
data (Bitmap) and awaits a decode start signal from 



the system controller to read out the data. 
[0036] The system controller executes reading in real 
time when it is determined from the horizontal and ver- 
tical sync signals that the television scanner is at a po- 
5 sition corresponding to the position indicated by the 
position_data. For real time display, the reading rate 
should correspond to a picture element sampling rate, 
preferably 13.5 MHz. As discussed, the subtitle data 
preferably is written into tha code buffer at a rate of 2.5 
10 MHz or more. Thus, the 13.5 MHz sampling clock is di- 
vided into four clock cycles of 3.375 MHz each. One of 
these 3.375 MHz clock cycles is allocated to writing (be- 
cause writing requires at least 2.5 MHz) and the remain- 
ing three clock cycles are allocated to reading data from 
15 the code buffer, thus satisfying the requirement for real 
time display. 

[0037] The read/write operation described is not only 
performed in real time, but also provides high resolution. 
Eight bits of the subtitle data are read from the code buff- 
er 22 for each of three clock cycles, or twenty-four bits 
per sampling clock. When display of the picture is con- 
ducted by the television monitor every fourth clock cycle, 
one-fourth of the twenty -four bits, (24/4 =) 6 bits are dis- 
played at every clock cycle. That is, each subtitle picture 
element may comprise six bits, which is more than suf- 
ficient to achieve a high quality of resolution for the sub- 
titles. 

[0038] The operation of the code buffer 22 and corre- 
sponding components of Fig. 2 is depicted as a block 
diagram in Fig. 11 . The code buffer 22-1 accumulates 
streams of subtitle data until at least one page of subtitle 
data is accumulated in the code buffer. The subtitle data 
for one page is transferred from the code buffer 22-1 to 
the display memory 22-2 (which acts as a buffer for the 
subtitle decoder) when the display time stamp (PTS) is 
aligned with the synchronizing clock (SCR). The syn- 
chronizing clock advances a pointer in the display mem- 
ory 22-2 during reading indicating which address of sub- 
title data is being currently read. It will be noted that plac- 
ing the code buffer and display memory in a single unit 
is preferred since the code buffer need only increment 
one pointer pointing to the current address in the display 
memory 22-2 which stores the next set of subtitle data. 
Thus, no delay is caused due to a transfer, resulting in 
a high speed transfer of the subtitle data. 
[0039] When the code buffer is read during a normal 
playback mode, the synchronizing clock advances the 
pointer of the display memory 22-2 at each pulse. How- 
ever, during special reproduction (such as fast-forward, 
fast-reverse playback modes), the pointer must be ad- 
vanced at a different rate. A special command is first 
sent to the controller 35 and the controller sends back 
an acknowledge signal (specia1_ack), acknowledging 
that special reproduction is to be initiated. To uniformly 
speed up (or slow down) the operations of the subtitle 
decoder according to the special reproduction rate, the 
system clock reference (SCR) can be altered by adding 
or subtracting clock pulses. Subtraction pulses are cre- 
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ated at an n times rate corresponding to the rate of fast- 
feeding or fast-reverse feeding. For example, atthetime 
when special reproduction is commenced, real time 
subtraction is performed on the bit stream of subtitle da- 
ta read out from the code buffer at the n times rate and 
the pointer advances at the desired rate to effect the 
special playback mode. 

[0040] When the special reproduction operation cor- 
responds to a pause operation, on the other hand, no 
subtraction pulses are created. Instead, an identical 
frame is continuously read from the code buffer repeat- 
edly, thus providing the sensation illusion that the sub- 
titles are paused. 

[0041] The reading operation is ended when the sub- 
title decoder 7 determines that an end of page (EOP) 
of the subtitle frame is reached. The system controller 
1 4 sends a repeat time signal to the controller 35 which 
indicates the length of a page. An inverse run-length cir- 
cuit 24 includes a counter and sends a display end sig- 
nal to the controller 35 when the count value of the coun- 
ter reaches the value indicated by the repeat time sig- 
nal. When the controller 35 determines that the repeat 
time is reached, the reading operation of the code buffer 
is stopped. The code buffer preferably stores 
at least two pages of subtitle data because one page 
will be read as another page is written into the code buff- 
er. 

[0042] The controller 35 issues a buffer overflow sig- 
nal to the system controller 14 when an overflow of the 
code buffer occurs. An overflow can be determined 
when the controller receives the display end signal 
from the run-length circuit 24 before the word detector 
20 receives an end of page (EOP) signal on the follow- 
ing page. At that time, the system controller 14 with holds 
transfer of subtitle data from the data decoder and de- 
multiplexer 1 (Fig. 1 ) to the word detector to prevent an 
overflow of the code buffer. When an overflow condition 
has passed, the next stream will be written into the code 
buffer and displayed at the correct display start position. 
[0043] An underflow condition exists when the code 
buffer has completed reading the subtitle data for an en- 
tire page and no further data exists in the code buffer. 
A code buffer with a capacity of two pages is depicted 
by the "code buffer size" line in Fig. 10. Graphically, an 
underflow would appear in Fig. 1 0 as one of the vertical 
portions of line (C) which extends below the lower limit 
of the code buffer. By contrast, an overflow condition is 
graphically depicted in Fig. 10 when the subtitle data 
read into the code buffer is too large, i.e., the horizontal 
portion of line (C) extends beyond line (B). 
[0044] Fig. 1 0 graphically demonstrates the data flow 
into and out of the code buffer 22. The T-axis (abscissa) 
represents time, while the D-axis (ordinate) represents 
data size for each page of data. Thus, the gradient (rise/ 
run) represents the data flow rate of the subtitles into 
the code buffer. Graph (C) represents the data flow of 
the subtitle data. The vertical portions of graph (C) indi- 
cate a transfer of subtitle data from the code buffer when 



the display time stamp (PTS) is aligned with the syn- 
chronizing clock (SCR) generated internally by the sub- 
title decoder 7. The horizontal portions of the graph (C) 
indicate the transfer of subtitle data into the code buffer. 
s For example, at a time that the display time stamp (PTS) 
forpage(SO) is received by the code buffer, theprevious 
page of 

subtitle data is transferred from the code buffer and 
page (SO) is written into the code buffer. When.another 

10 display time stamp (PTS) is received by the code buffer, 
the subtitle data of page (SO) is transferred out of the 
code buffer and page (S1 ) is written in. Similarly, the re- 
maining pages (S2), (S3) are written into and read out 
of the code buffer as indicated. 

15 [0045] To precisely time the reading of the subtitle da- 
ta from the code buffer with the display of the video im- 
age, delay compensation must be performed to allow 
for delays within the subtitle decoder. This is especially 
important where an extern al memory is employed as the 

20 display memory because an external memory increases 
the delay factor. Delay compensation is achieved by 
controlling the timing of the decode start command 
from the system controller 14. The system controller 14 
delays the decode start command by a time equal to 

25 the processing of a letter box picture (approximately one 
field) and a delay caused by video decoding at the in- 
stant the synchronizing clock of the controller (SCR) is 
aligned with the display time stamp (PTS). Delay com- 
pensation is particularly useful, since the video, audio 

30 and subtitle data are multiplexed on the premise that the 
decode delay in each of the video, audio and subtitle 
data signals is zero in the data encoding apparatus. 
[0046] When the subtitle data for one page is read out 
of the display memory 22-2 (Fig. 1 1 ), the headers of the 

35 bit streams are separated therefrom by a parser 22-3 
and forwarded to the inverse variable-length coder or 
ru n-length decoder 23, 24 during a vertical blanking pe- 
riod (V). The inverse VLC (Variable Length Coding) cir- 
cuit 23 (Fig. 2) subjects the subtitle data to variable 

40 length decoding. The variable length decoded subtitle 
data is composed of level data ("1 " or "O") and run data 
as paired data. In the case were variable length decod- 
ing is not employed, the inverse VLC circuit may be by- 
passed and the subtitle data read from the code buffer 

45 will be directly outputto the inverse run-length circuit 24. 
The inverse run-length circuit 24 conducts run-length 
decoding by generating the level of data from the 
number of run data elements. Thus, the VLC circuit 23 
and the run-length circuit 24 decompress the subtitle da- 

50 ta which had been stored as compressed data in the 
code buffer 22. 

[0047] The decompressed subtitle data is then sent 
to a 3:4 filter 25. The 3:4 filter receives an xsqueeze 
signal from the system controller 14 indicating the as- 
55 pect ratio of the corresponding television monitor. 
Where the signal indicates that the monitor has a 4:3 
aspect ratio, the 3:4 filter applies 3:4 filtration processing 
to the subtitle data to match the size of the subtitles to 
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the size of the video picture. There are no Fig. 1 1 . In the 
preferred embodiment, the controller 35 reads 90 pixels 
worth of subtitle data from the code buffer 22 before the 
H sync pulse is generated. In the case where the tele- 
vision monitor already has a 16:9 aspect ratio, or the 
decompressed subtitle data represents fonts, the 3:4 fil- 
ter is bypassed as shown in Fig. 11 . 
[0048] A color look-up table 26 (CLUT) receives the 
subtitle data from the 3:4 filter 25 and the CLUT_data 
from the code buffer 22. The color look up table gener- 
ates a suitable colorfrom the CLUT_data forthe subtitle 
data. The color look up table selects an address corre- 
sponding to the subtitle data for each pixel and forwards 
a mixing ratio K and color components Y (luminance), 
C R (color difference signal R-Y) and C B (color difference 
signal B-Y) to the mixer 34. The color components Y, C R 
and C B , when mixed by the mixer, at the mixing ratio K 
create a pixel with the color indicated by the color look 
up table. 

[0049] Background video data is incorporated in the 
arrangement of the color look-up table. For example, ad- 
dress 0 of the look-up table includes key data K having 
the value of 00 h; which means that the subtitle data will 
not be seen and the background video data will mani- 
fest., as shown by regions T1 and T5 in Fig. 5c. Address- 
es 1 h to 6h of the look-up table include values of the key 
data K which increase linearly (20, 40 ... CO hexadeci- 
mal); which means that the subtitle pixels according to 
these addresses are mixed with the background data as 
shown by the regions T2 and T4 in Fig. 5c. Finally, ad- 
dresses 8h to Fh of the look-up table include values of 
key data K of EOh; which means that the components 
Y, Cr and Cb are mixed without any background video 
data as shown by region T3 in Fig. 5c. The color look- 
up table data is generated from the system controller 
and is previously downloaded to the CLUT circuit before 
decoding. With the color look-up table, the filtered sub- 
title data is transformed into the appropriate color pixel 
for display on the television monitor. 
[0050] Fig. 6 shows an example of a color look-up ta- 
ble where the components Y, Cr, Cb and K are arranged 
according to the addresses 0...F (hexadecimal). As will 
be explained, color wiping is performed by changing the 
CLUT_data, thereby replacing part of the color look up 
table by the color wiping color look up table, shown in 
Fig. 9. Normally, a particular subtitle frame is refreshed 
several times because frames are refreshed on a tele- 
vision several times a second. When the subtitles are 
refreshed, the same subtitle data will be employed. 
However, the color will be different due to the changed 
color look up table. Thus, the subtitles will appear to be 
color wiped as they are refreshed with each consecutive 
frame. 

[0051] A mixer 34 (Fig. 2) mixes the pixels from the 
color look-up table 26 with video data from the video 
decoder 3 (Fig. 1). The resulting mixed data represents 
a video picture with superimposed subtitles and is ready 
to be output to a television monitor. The mixer 34 is con- 



trolled to position the subtitles within the video picture. 
The system controller 14 sends a u_position signal 
generated by the commands of an operator to the mixer 
via controller 35 which designates the vertical position 
5 for display on the screen. The u_position value may be 
varied (either by a user, the transmitter, or otherwise) 
allowing a user to place the subtitles anywhere along a 
vertical axis. 

[0052] A decoding apparatus embodying the inven- 
10 tion may be practiced with the parameters for the differ- 
ent signals shown in Fig. 4. However, the present inven- 
tion is not limited to the parameters set forth in that figure 
and may be employed in different video systems. 
[0053] With the present apparatus, a viewer has con - 
*5 trol over the display of the subtitle through the mode dis- 
play device 9. The system controller 1 4, upon command 
from the user, sends a control signal to the mixer 34 (Fig. 
2), turning the subtitles on or off. Since the present ap- 
paratus decodes subtitles in real time, the user does not 
20 experience any unpleasant delay when turning the sub- 
titles on or off. In addition, the subtitles can be controlled, 
by the user or otherwise, to fade-in/fade out at a variable 
rate. This is achieved by multiplying a fade coefficient 
to the pattern data representing the subtitles at a desig- 
ns nated speed. This function also allows an editor of the 
subtitles to present viewers with different sensations ac- 
cording to the broadcast of the audio/video picture. For 
example, news information may be "flashed" rapidly to 
draw the attention of the viewer, whereas subtitles in a 
30 slow music video "softly" appear in order not to detract 
from the enjoyment of the music video. 

Encoding Technique 

35 [0054] The encoding technique employed in the pre- 
ferred form of implementation of the invention will be de- 
scribed in more particular detail with reference to Figs. 
5a, 5b and 5c and Fig. 6. As an example, the technique 
for encoding the letter "A" of Fig. 5a will be explained. 

40 The letter "A" is scanned along successive horizontal 
lines and the fill data of Fig. 5b is generated for the letter 
"A" along each horizontal line. It will be noted that the 
level "E0" demarks the highest level for recreating a 
color pixel from the color look-up table shown in Fig. 6, 

45 whereas level "0" represents a lack of subtitle data. 
[0055] The key data (K) (or mixing ratio) determines 
the degree to which the fill data is mixed with back- 
ground video. Regions T1 and T5 of the key data corre- 
spond to areas in the video picture that are not super- 

50 imposed with the fill data; therefore, these areas are 
designated as level 0 as indicated by address 0 in Fig. 
6. Regions T2 and T4 are mixed areas where the sub- 
titles are gradually mixed with the background video pic- 
ture so that the subtitles blend into the background video 

55 picture and do not abruptly contrast therewith. Any of 
the fill data in this area is stored in addresses 1 through 
6 of the color look up table. The main portion of the letter 
"A" is displayed within the T3 region where the back- 
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ground information is muted. The subtitle information in 
region T3 is stored as addresses 7 to F (hexadecimal). 
The color look-up table of Fig. 6 is arranged in varying 
degrees of the luminance component Y. When a pixel in 
the region T3 is to be stored, for example, and the level 
of the luminance component Y for that particular pixel is 
20 (hexadecimal), the color information for that pixel is 
obtained from address 9. In this manner, the remaining 
pixels for the subtitle characters are encoded. 

Encoding Apparatus 

[0056] Encoding apparatus embodying the invention 
is depicted in Figs. 7a, b. Audio and video information 
is received by a microphone 53 and video camera 51, 
respectively and forwarded to a multiplexer 58. The sub- 
title data are entered through either a character gener- 
ator 55 or a flying spot scanner 56 and encoded by a 
subtitle encoding circuit 57. The encoded subtitle infor- 
mation is sent to the multiplexer 58 and combined with 
the audio/video information onto a record disc 91 or 
channel for transmission, display, recording or the like. 
[0057] The video camera 51 generates the video sig- 
nal and supplies the same to a video encoding unit 52 
which converts the video signal from analog to digital 
form. The digitized video signal is then compressed for 
video transmission and forwarded to a rate controller 
52a, which controls the rate that the compressed video 
data is transferred to the multiplexer in synchronism with 
the rate that the subtitles are sent to the multiplexer. In 
this manner, the compressed video data is combined 
with the subtitle data at the correct time. Similarly, audio 
information is obtained by the microphone 53 and en- 
coded by an audio encoding unit 54 before being sent 
to the multiplexer. The audio encoding unit does not nec- 
essarily include a rate controller because the audio data 
may ultimately be recorded on a different track or trans- 
mitted over a different channel from the video data. 
[0058] The subtitles are generated by either character 
generator 55 or flying spot scanner 56. The character 
. generator includes a monitor and a keyboard which al- 
lows an operator to manually insert subtitles into a video 
picture. The operator edits the subtitles by typing the 
subtitles through the keyboard. The flying spot scanner 
56, on the other hand, is provided in the situation where 
subtitles are already provided in an external video pic- 
ture. The flying spot scanner scans the video picture and 
determines where the subtitles are positioned and gen- 
erates corresponding subtitle data therefrom. The sub- 
titles from the flying spot scanner are pre-processed by 
the processing circuit 63 to conform with subtitles gen- 
erated by the character generator and forwarded to the 
subtitle encoding circuit. 

[0059] The subtitle data from either the character gen- 
erator 55 or the flying spot scanner are then selected for 
compression. The character generator outputs blanking 
data, subtitle data and key data. The subtitle data and 
key data are forwarded to a switch 61 which is switched 



according to a predetermined timing to select either the 
subtitle or key data. The selected data from switch 61 is 
filtered by a filter 72 and supplied to another switch 62. 
Switch 62 switches between the blanking data, the fil- 
5 tered data from the character generator and the proc- 
essed data from the flying spot scanner. When it is de- 
termined that no subtitles are present, the blanking data 
is chosen by the switch 62. Where subtitles are present, 
the switch 62 chooses between the character generator 
10 data or the flying spot scanner data, depending upon 
which device is being used to generate the subtitle data. 
[0060] The data selected by switch 62 is then quan- 
tized by a quantization circuit 64, using a quantization 
based on data fed back from a subtitle buffer verifier 68. 
The quantized data, which may be compressed, is sup- 
plied to a switch 69 and (during normal operation) for- 
warded to a differential pulse code modulation (DPCM) 
circuit 65 for pulse code modulation. The modulated da- 
ta is run-iength encoded by a run-length coding circuit 
66 and variable-length encoded by a variable-length en- 
coding circuit 67 and forwarded to the subtitle buffer ver- 
ifier 68 for final processing before being sent to the mul- 
tiplexer 58. 

[0061] The subtitle buffer verifier 68 verifies that the 
buffer is sufficiently filled with data without overflowing. 
This is done by feeding a control signal (referred to in 
Fig. 7A as a filter signal) back to the quantization circuit 
64. The control signal changes the quantization level of 
the quantization circuit, thereby changing the amount of 
data encoded for a particular subtitle. By increasing the 
quantization level, the amount of data required for the 
subtitle data is reduced and the bit rate of data flowing 
to the subtitle buffer verifier is consequently reduced. 
When the subtitle buffer verifier determines that there is 
an underflow of data, the control signal decreases the 
quantization level and the amount of data output from 
the quantization circuit increases, thereby filling the sub- 
title buffer verifier. 

[0062] The subtitle buffer verifier is also responsible 
for preparing the subtitle data for transmission (over tel- 
evision airwaves, for example). The subtitle buffer veri- 
fier inserts information necessary to decode the encod- 
ed subtitle data. This information includes a normal/spe- 
cial play signal which indicates whether the subtitles are 
recorded in a normal or special (fast-forward/reverse) 
mode. An upper limit value signal is inserted which in- 
dicates the upper limit for the memory size of the subtitle 
data for a frame. An EOP signal marks the end of page 
for the subtitle data frame and also is inserted. A time 
code signal is inserted which is used as the time stamp 
PTS in decoding. Subtitle encoding information is in- 
serted and includes information used in encoding the 
subtitle data, such as the quantization factor. Positional 
information is inserted and is used as the 
position_data upon decoding. Astatic/dynamic signal 
is inserted which indicates whether the subtitle data is 
in static or dynamic mode. The subtitle buffer verifier al- 
so inserts the color look up table address for transmis- 
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sion to the decoder so that the colors of the display will 
match the colors employed in creating the subtitles. 
[0063] The subtitle buffer verifier is preferably a code 
buffer similar to the code buffer 22 of the decoder (Fig. 
2). To that end, it is useful to think of the operation of the 
subtitle buffer verifier to be in symmetry (i.e., performing 
the inverse functions of the code buffer) with the code 
buffer operational diagram of Fig. 11 . For example, the 
color pixels of the subtitles are converted into digital rep- 
resentations; the digital subtitles are encoded by a run 
length encoder and a variable length encoder; header 
information is added; and the resultant subtitle informa- 
tion is stored in a buffer and forwarded to a multiplexer 
for multiplexing with the audio and video data. 
[0064] The multiplexer 58 multiplexes the encoded 
subtitle data with the video and audio data, preferably 
employing a time-sliced multiplexing encoding unit. The 
multiplexer also provides error correction processing (e. 
g., error correction coding) and modulation processing 
(e.g., EFM, eight-to-fourteen modulation). The multi- 
plexed data is then transmitted (via television broad- 
casting, recording, or other means of transference) to 
the decoding apparatus for decoding and display. 

Colorwiping Encoding 

[0065] Colorwiping refers to a process by which an im- 
age, such as the subtitles, is gradually overlayed with 
another image. An exemplary application of colorwiping 
is highlighting, wherein a frame of subtitles is dynami- 
cally highlighted from left to right with the passage of 
time. Highlighting is particularly useful in, for example, 
Karaoke where the displayed lyrics are highlighted from 
left to right as the lyrics are sung. 
The preferred form of implementation of the invention 
performs colorwiping by changing the color look up table 
at different points of the subtitle display. For example, 
an initial subtitle frame is generated with the standard 
color look up table in Fig. 6. When colorwiping is per- 
formed, the color look up table is. changed from the 
colorwiping to the standard color look provides the sen- 
sation that the subtitles are changing color dynamically 
over time from left to right. 

[0066] An encoding operation for color wiping will now 
be discussed with reference to Figs. 7a, 8a and 8b. Dur- 
ing the course of encoding subtitles, an operator may 
desire to color wipe the previously encoded subtitles. To 
that end, the. operator is provided with a wipe lever 81 
to control the colorwiping and a monitor 84 to view the 
color wiping in real time. The wipe lever is connected to 
an adapter 82 to adapt the analog voltages of the wipe 
lever to digital impulses suitable for digital manipulation. 
The digital output of the adapter is fed to both a switcher 
83 and a wipe data sampler 70. The switcher switches 
the color look up table to values represented by the po- 
sition of the wipe lever and generates color pixels of the 
subtitles for display on the monitor. Thus, the operator 
can visually inspect the colorwiping procedure while it 



occurs and adjust the speed or color of the wiping to 
satisfaction. 

[0067] The wipe data sampler and position sampler 
70 determines from the adapter signals where in the vid- 

5 eo picture the color look up table is to be changed and 
outputs this information to the encoding circuits 65, 66 
and 67 (via switch 69).for encoding and transmission to 
the multiplexer 58. Figs. 8a and 8b depict a block dia- 
gram of the operation of the wipe data and position sam- 

10 pier. A comparator compares a present pixel signal gen- 
erated by the adapter with a previous pixel signal from 
the adapter. This is achieved by transmitting the present 
pixel value to input A of a comparator 301 while supply- 
ing the previous pixel value latched in a register 300 to 

15 input B of the comparator 301 . The comparator outputs 
a boolean "true" value to a counter 302 (which is reset 
at every horizontal or vertical sync pulse) when the 
present and previous pixels have the same value and 
the counter increments a count value. That is, the com- 

20 parator registers a true condition when the pixels up until 
that point are generated from the same color took up 
table. At the point where thecolor look uptablechanges, 
therefore, the present and previous pixels become un- 
equal (i.e., their colorchanges) and the comparator gen- 

25 erates a "false" boolean condition. The count value, 
thus, is equal to the number of matches between the 
present and previous values, which is the same as the 
position at which the color look up table changes. The 
count value is latched by a register 303 upon the follow- 

30 jng vertical sync pulse and transferred to the encoding 
circuits (via switch 69) for transmission. 

Colorwiping Decoding 

35 [0068] Color wiping decoding will now be discussed 
with reference to Figs. 12a-cand 13. Fig. 12a shows the 
position where the color took up table is switched at point 
A from a color wiping look up table (Fig. 9) to the stand- 
ard color look up table (Fig. 6). Fig. 1 2b depicts a pattern 

40 of subtitle and colorwipe data arranged in -discrete 
blocks of presentation time stamps. (PTS(n) ... PTS 
(n+t)). The first presentation time stamp PTS(n) corre- 
sponds to normal subtitle data and the remaining pres- 
entation time stamps PTS(n+1 ... n+t) correspond to 

45 colorwiping data (WPA ... WPZ). Fig. 12c shows suc- 
cessive frames (n ... n+t) which correspond to the pres- 
entation time stamps. To execute colorwiping, each suc- 
cessive colorwiping frame (WPA ... WPZ) sets the point 
where the color look up table is switched (point A) further 

50 along the displayed subtitle, thereby dynamically per- 
forming colorwiping as a function of time. 
[0069] An operational block diagram of the colorwip- 
ing decoding is depicted in Fig. 13. The vertical sync 
pulse triggers a register 205 to latch the current subtitle 

55 frame (Fig. 13 shows a colorwiping frame WP being 
latched). The colorwiping data latched by the register 
indicates the position of the color look up table switch- 
ing. A pixel counter decrements the value indicated by 
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the colorwiping data at each horizontal sync pulse and 
outputs a boolean "true" flag to the color look up table 
26. While the flag Is "true" the color look up table em- 
ploys the colorwiping table (Fig. 9) to decode the colors 
of the subtitle pixels. When the pixel counter reaches 
zero, the position of color look table switching is reached 
and the pixel counter issues a boolean "false" flag to the 
color look up table 26. At this time, the color look up 
table switches the colorwiping color look up table (Fig. 
9) to the standard look up table (Fig. 6) : and the remain- 
der of the subtitle frame is displayed in standard color 
mode. Each successive colorwiping frame (WPA ... 
WPZ) moves the position of switching; thus, each re- 
freshed subtitle frame advances (or retreats) the color- 
wiping, thus performing dynamic colorwiping. 
[0070] The colorwiping color look up table in Fig. 9 
incorporates two sets of colors (one set for addresses 
Oh to 7h and a second set for addresses 8hto Fh). Thus, 
the colorwiping color can be changed to a secondary 
color simply by changing the most significant bit (MSB) 
of the color look up table address. For example, the first 
set of colorwiping colors has a MSB of 
"0", while the second set has a MSB of "I". Changing 
the MSB of address 7h to a "1" transforms the address 
to Fh and the colorwiping color changes. This may be 
done, for example, by setting the MSB equal to the flag 
of pixel counter 208. 

[0071 ] Employing the MSB to change between color . 
sets has the advantage of reducing the number of bits 
required to be encoded. Since the MSB is known, only 
the three lower order bits need to be encoded where 4 
bits are employed for every pixel. Where two bits are 
employed for every pixel, the subtitle data is coded only 
for the least significant bit. In a 4 bits per 2 pixel format, 
only the MSB is employed for color control and the re- 
maining three bits can be reserved for pixel information. 
Thus, by using the MSB the number of bits encoded can 
be decreased and the overall processing time for en- 
coding and decoding is optimized. 

Dynamic Subtitle Positioning 

[0072] The subtitles are repositioned dynamically, i. 
e., as a function of time, by employing a simiiar tech- 
nique as described above with reference to colorwiping. 
As shown in Figs. 14a-c, the position data is measured 
along the horizontal axis (Fig. 1 4a) and is transferred to 
the subtitle decoder with the subtitle data during the ap- 
propriate frame (Fig. 14c) corresponding to a presenta- 
tion time stamp (PTS(n), for example; Fig. 14b). 
[0073] The positioning operation will now be ex- 
plained with reference to Fig. 15. The position data is a 
value representing the position of the subtitle frame 
along the horizontal axis and is read out from the display 
buffer and latched by register 205 on each vertical sync 
pulse. Pixel counter 208 decrements the position data 
on each horizontal sync pulse and send a boolean flag 
to the controller 35 (Figs. 2 and 15) to indicate that the 



position of the subtitle frame has not been reached. 
When the pixel counter reaches zero, the position of the 
subtitle frame has been reached and the boolean flag is 
toggled to indicate this to the controller. The controller, 

5 which has been delaying the reading operation of the 
code buffer 22 (Fig. 2), then causes the code buffer to 
read out the subtitle data to the run length decoder 24 
(Fig. 2). The subtitle data is then decoded as described 
above and displayed with the corresponding video im- 

10 age. In this manner, the position of the subtitle frame is 
changed with each frame; thus providing dynamic 
movement of the subtitle frame. 

[0074] The preferred form of implementation of the in- 
vention thus provides subtitle colorwiping and dynamic 
15 positioning. Since the subtitles are encoded and decod- 
ed in real time separately from the audio/video data, the 
subtitles can be controlled with great flexibility. In Kara- 
oke, for example, the subtitles may be turned off at any 
time and instantaneously when it is desired to test the 
singer's skill in singing the song. Colorwiping and dy- 
namic positioning of the subtitles is also performed in 
real time, allowing an operator to quickly and easily pro- 
duce video pictures in mass. Moreover, the results of 
colorwiping and dynamic positioning may be instantly 
viewed by an operator and adjusted to satisfaction, pro- 
viding custom tailoring of each audio/video picture. 
[0075] It will be appreciated that the present invention 
is applicable to other applications, such as television or 
video graphics. It is, therefore, to be understood that, 
within the. scope of the appended claims, the invention 
may be practiced otherwise than as specifically de- 
scribed herein. 



Claims 

1. A subtitle position decoding apparatus supplied 
with multiplexed subtitle data and encoded video 
data, comprising: 

video decoding means for decoding the encod- 
ed video data of a video image to be displayed; 
buffer means for storing the subtitle data to be 
displayed contemporaneously with said video 
image; 

control means for timing a read out operation 
of said subtitle data from said buffer means dur- 
ing a real time display of said video image; and 
means for dynamically changing a position in 
the video image where said subtitle is superim- 
posed during display; wherein the means for 
dynamically changing comprises: 

latching means for latching a value indica- 
tive of said position where said subtitle is 
to be superimposed; and 
counting means for decrementing said val- 
ue each time a pixel of said video image is 
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displayed, 

wherein said control means performs said 
read out operation when said counting means 
reaches zero, thereby causing said subtitle to be su- 5 
perimposed with said video image at that time. 

2. The subtitle position decoding apparatus of claim 1 
further comprising: 

10 

delay compensation means for compensating 
a delay caused by components of the subtitle 
position decoding apparatus so as to display 
said subtitle with said video image at a position 
indicated by decoding information included in *5 
said subtitle data. 

3. The subtitle position decoding apparatus of claim 1 
further comprising subtitle decoding means for de- 
coding said subtitle data stored in said buffer 20 
means. 

4. The subtitle position decoding apparatus of claim 3 
further comprising mixing means for mixing said 
video data decoded by said video decoding means 25 
with said subtitle data decoded by said subtitle de- 
coding means. 

5. A subtitle position decoding method for decoding 
subtitle data multiplexed with encoded video data 30 
comprising the steps of: 

video decoding the encoded video data of a vid- 
eo image to be displayed; 

storing the subtitle data in a buffer to be dis- 35 
played contemporaneously with said video im- 
age; 

timing a read out operation of said subtitle data 
from said buffer during a real time display of 
said video image; and 40 
dynamically changing a position in the video im- 
age where said subtitle is superimposed during 
display; 

wherein the position of said subtitle is dynamically 45 
changed by: 

latching a value indicative of said position 
where said subtitle is to be superimposed; and 
decrementing said value each time a pixel of so 
said video image is displayed, 

wherein said read out operation is performed 
when said value is decremented to zero, causing 
said subtitle to be superimposed with said video im- 55 
age at that time. 

6. The subtitle position decoding method of claim 5 



further comprising delay compensating an inherent 
delay caused by the subtitle position decoding 
method. 

7. The subtitle position decoding method of claim 5 
further comprising decoding said subtitle data 
stored in said buffer. 

8. The subtitle position decoding method of claim 7 
further comprising mixing said decoded video data 
with said decoded subtitle data. 

9. The subtitle position decoding method of claim 5 
further comprising repeating said steps of video de- 
coding, storing, reading and dynamically changing 
for different subtitles having different positions 
whereat the subtitles are to be superimposed on the 
video image. 
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